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dynamic  scenes,-j|g  presence  of  object  boundaries  is  often  signaled  by  the 
appearance  or  disappear  anceof  occluded  surfaces  over  HBf  Sucffrregions  of  sur¬ 
face  accretion  or  deletion  can  be  found  using  matching  techniques  similar  to  those 
used  to  determine  optical  flow  in  an  image  sequence.  Regions  in  one  frame  that  are 
not  adequately  matched  by  any  region  in  previous  frames  correspond  to  accretion. 
Regions  that  have  no  matches  in  subsequent  frames  correspond  to  deletion.  In 
either  case,  an  occlusion  boundary  is  present.  Furthermore,  by  associating  accretion 
or  deletion  regions  with  a  surface  on  one  side  of  a  boundary,  it  is  possible  to  deter¬ 
mine  which  side  of  the  boundary  is  being  occluded.  This  association  can  be  based 
purely  on  visual  motion^- Jthe  accretion  or  deletion  region  moves  with  the  same 
image  velocity  as  the  remaining  visible  surface  to  which  it  is  attached.  <  . 


1.  Introduction 


Locating  object  boundaries  in  images  is  an  important  but  difficult  problem.  Intensity- 
based  edge  detection  provides  ambiguous  or  misleading  boundary  information  in  many 
situations,  such  as  textured  regions.  Motion-based  techniques  can  provide  more  reliable 
results  in  these  cases.  At  object  boundaries  where  occlusion  occurs,  surface  regions  will 
typically  appear  or  disappear  over  time  when  motion  is  present.  These  regions  of  changing 
visibility  may  be  used  to  indicate  both  object  boundaries  and  the  side  of  the  boundary 
corresponding  to  the  occluded  surface.  — 


At  a  typical  object  boundary,  one  surface  will  be  blocking  the  view  of  another  more 
distant  surface.  In  the  presence  of  motion,  regions  of  the  more  distant  surface  will  often 
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either  appear  or  disappear  from  view  over  time.  Such  regions  are  called  areas  of  accretion 
or  deletion ,  respectively.  A  similar  situation  arises  in  stereo  vision,  where  a  region  of  the 
more  distant  surface  near  an  occlusion  edge  will  be  visible  in  one  image  of  the  pair  but 
invisible  in  the  other  image.  Thus,  recognition  of  accretion/deletion  regions  is  a  means  of 
locating  object  boundaries  in  image  sequences.  In  addition,  accretion  and  deletion  regions 
will  belong  to  the  occluded  surface,  providing  sufficient  information  to  determine  which  of 
the  two  surfaces  at  a  boundary  is  being  occluded.  To  recover  the  information  available 
from  such  regions,  it  is  necessary  to  determine  both  how  regions  of  accretion  and  deletion 
in  the  imagery  may  be  identified,  and  what  characteristics  of  such  regions  permit 
identification  of  the  occluded  surface. 

This  paper  describes  a  scheme  to  locate  regions  of  accretion  and  deletion,  and  to  iden¬ 
tify  occluding  surfaces  at  a  boundary  using  these  regions.  A  technique  which  matches  image 
features  in  two  frames  is  used  to  determine  feature  displacement  on  the  image  plane.  Areas 
in  the  image  with  a  high  percentage  of  features  which  are  unmatch  able  in  a  previous  or  sub¬ 
sequent  image  are  identified  as  accretion  or  deletion  regions,  respectively.  These  regions 
indicate  the  presence  of  an  occlusion  boundary.  Since  the  accretion/deletion  region  belongs 
to  the  occluded  surface,  it  will  be  displaced  on  the  image  plane  in  the  same  fashion  as 
nearby  areas  of  that  surface.  The  occluded  surface  is  then  identified  by  determining  which 
of  the  two  surfaces  adjacent  to  the  accretion/deletion  region  displays  a  similar  displacement 
on  the  image  plane.  This  identification  combines  information  about  accretion  and  deletion 
with  optical  flow  to  produce  a  description  of  the  occlusion  boundary  more  complete  than 
any  existing  technique  based  purely  on  flow  alone. 

Several  research  efforts  in  computational  vision  have  utilized  motion  information  to 
recover  object  boundaries.  The  basic  idea  behind  most  motion-based  approaches  is  that 
image  plane  motion,  or  optical  flow,  acrom  the  object  surface  will  be  constant  or  slowly- 
varying,  and  discontinuities  in  flow  will  occur  only  at  object  edges.  Previous  approaches 
either  search  for  discontinuities  in  the  optical  flow,  or  group  together  regions  of  similar 
flow.  Nakayama  and  Loomis  [1]  propose  a  local,  center-surround  operator  for  detecting 
object  boundaries  in  flow  fields.  Clocksin  [2]  shows  that  zero-crossings  will  occur  at  edge 
locations  in  the  Laplacian  of  the  magnitude  of  the  optical  flow  Held  when  an  observer 
translates  through  an  otherwise  static  environment.  Thompson  et.  al.  [3,4]  demonstrate  that 
the  Laplacian  is  useful  as  an  edge  detector  in  the  more  general  case  of  unconstrained 
motion.  After  obtaining  point  velocities  by  template  matching.  Potter  [3]  groups  all  points 
with  the  same  velocity  into  tingle  object  regions.  Similarly,  Fennema  and  Thompson  [6]  use 
the  spatial  and  temporal  gradients  of  intensity  to  obtain  point  velocities,  and  then  consider 
all  points  with  similar  velocities  to  be  part  of  the  same  object.  Thompson  [7]  develops  a 
grouping  scheme  based  upon  both  intensity  and  velocity  information.  Regions  of  both 
identical  intensity  and  identical  velocity  are  formed,  followed  by  merging  of  adjacent 
regions  based  upon  similarities,  or  at  least  lack  of  conflict,  in  intensity  and  velocity.  With 
the  exception  of  Clocksin's  work  [2],  these  flow-based  techniques  are  unable  to  provide  any 
indication  of  tbe  occluded  surface  at  an  edge. 

Accretion  and  deletion  are  fundamental  to  motion  analysis  based  on  differencing  [8,9]. 
These  techniques  subtract  one  image  from  another  and  then  use  the  presence  of  regions  of 
significant  difference  to  infer  properties  of  object  boundaries  and  motion.  The  approach  is 
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most  effective  when  i  reasonably  homogeneous  object  is  moving  relative  to  a  homogeneous 
background  with  different  luminence.  Covering  and  uncovering  of  the  background  leads  to 
significant  differences  between  frames,  allowing  boundaries  to  be  located.  Analysis  of  these 
difference  regions  over  time  can  often  be  used  to  associate  the  difference  region  with  adja¬ 
cent,  non-changing  areas  of  the  image  sequence  and  thereby  identify  which  side  of  the 
boundary  is  being  occluded.  This  scheme  is  intensity-based,  and  suffers  when  intensity  con¬ 
trasts  occur  that  are  not  related  to  object  structure.  A  textured  object  which  changes  loca¬ 
tion  on  the  image  plane,  for  example,  will  produce  many  regions  of  intensity  difference 
which  are  not  accretion  or  deletion  regions. 

Only  limited  experimentation  has  been  directed  at  the  role  of  accretion  and  deletion  in 
human  perception.  Kaplan  [10]  showed  that  patterns  of  accretion  and  deletion  in  fields  of 
moving  random  dots  provide  sufficient  information  for  the  judgment  of  relative  depth  by 
human  subjects.  In  bis  stimuli,  a  single  edge  separated  two  regions  of  random  dots,  where 
each  region  moved  coherently.  The  edge  wu  implicit,  being  the  line  along  which  accretion 
and/or  deletion  occurred,  and  thus  wu  not  visible  if  all  of  the  dots  were  stationary.  Sub¬ 
jects  consistently  perceived  the  more  distant  surface  to  be  the  one  which  wu  undergoing 
accretion  or  deletion  at  a  greater  rate.  This  wu  true  even  when  the  implicit  edge  moved 
with  a  velocity  different  than  the  velocity  of  points  on  either  surface.  In  these  cases  of 
inconsistent  edge  motion,  there  wu  more  ambiguity  in  the  perceptions  of  subjects,  although 
the  statistically  significant  perception  wu  that  the  surface  with  a  greater  rate  of  accretion  or 
deletion  was  more  distant.  This  suggests  that  both  edge  velocity  and  accretion/deletion  are 
important  factors  in  the  perception  of  depth  at  an  edge,  but  that  accretion/deletion  informa¬ 
tion  may  be  dominant. 

3.  Detecting  accrctUa/ddcdau  remans 

A  motion-based  scheme  for  identifying  accretion  and  deletion  regions  is  developed 
here.  To  recover  motion  on  the  image  plane,  corresponding  structures  in  each  frame  of  an 
image  pair  are  located.  The  result  of  this  is  a  disparity  vector  field,  where  each  vector 
represents  the  change  in  image  plane  location  of  a  structure.  (Disparity  is  the  discrete 
representation  of  optical  flow  arising  from  image  sequences  that  are  discretely  sampled  in 
time.)  This  correspondence  is  accomplished  by  token  matching.  A  token  is  a  distinctive 
region  in  the  image,  which  is  identified  by  some  predefined  local  operator.  A  set  of  tokens 
is  obtained  for  each  image  in  the  pair,  and  an  organized  search  is  performed  to  match 
tokens  from  the  first  image  to  corresponding  tokens  in  the  second  image  using  the  relaxa¬ 
tion  labeling  technique  described  in  [11].  Possible  matches  between  tokens  in  the  two 
frames  are  evaluated  based  on  two  criteria:  the  similarity  between  properties  of  the  tokens, 
and  a  surface  smoothness  meuure  that  favors  matches  with  disparities  similar  to  neighbor¬ 
ing  tokens.  An  important  aspect  of  this  particular  matching  technique  is  that  it  can  deter¬ 
mine  that  a  token  in  one  frame  is  unmatchahie  if  no  token  in  the  other  frame  satisfies  the 
appropriate  matching  criteria.  By  basing  the  analysis  on  the  motion  of  tokens  in  the  image, 
many  of  the  intensity  contrast  problems  of  a  differencing  system  are  circumvented. 

Regions  of  accretion  and  deletion  are  identified  by  analyzing  unmatcbable  tokens  in 
either  image.  A  token  may  not  be  matcbable  either  because  the  token  detector  failed  to 
find  the  corresponding  structure  in  the  other  image  of  the  pair,  or  because  the  correspond¬ 
ing  token  is  not  visible  in  the  other  image.  Regions  with  a  high  ratio  of  unmatcbable  tokens 
to  total  tokens  are  likely  to  be  region  of  accretion  or  deletion.  This  motion-based,  token- 
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matching  approach  it  an  implementation  of  Kaplan’s  model  for  detecting  such  regions  [12]. 
Kaplan  argues  that  accretion  and  deletion  are  detected  in  the  human  visual  system  by  isolat¬ 
ing  clusters  of  elements  of  optical  texture,  tracking  them  over  time,  and  responding  when 
they  change  in  some  way  that  is  not  topologically  permissible.  Token  identification  is 
equivalent  to  isolating  elements  of  optical  texture;  token  matching  serves  the  purpose  of 
tracking  such  elements  over  time;  and  analyzing  unmatchable  tokens  is  a  response  to  some 
change  which  may  be  due  to  appearance  or  disappearance  of  a  region. 

4.  Identifying  OcdadeJ  Surfaces. 

Not  only  can  accretion/deletion  patterns  be  used  to  locate  boundaries,  they  provide 
information  that  allows  the  identification  of  the  side  of  the  boundary  being  occluded.  Such 
information  is  beneficial  when  interpreting  dynamic  scenes.  Several  specific  approaches  are 
possible,  though  all  are  based  on  associating  the  accretion  or  deletion  region  with  a  surface 
on  one  side  of  the  boundary.  That  surface  is  the  one  being  occluded.  One  approach  relies 
upon  the  relative  location  of  the  accretion/deletion  region  with  respect  to  the  precise  posi¬ 
tion  of  the  image  of  the  boundary.  This  boundary  is  the  actual  point  of  occlusion,  the 
accretion/deletion  region  being  on  the  same  side  of  the  boundary  as  the  occluded  surface. 
Figure  1  illustrates  this  concept.  The  primary  difficulty  in  this  approach  is  identifying  the 
boundary  location  relative  to  the  accretion/detetion  region.  In  particular,  motion-based 
edge  detection  cannot  locate  the  boundary  precisely  enough  without  first  knowing  which 
surface  is  occluded.  The  inadequacies  of  intensity-based  edge  detectors  for  this  purpose  are 


Figure  1.  Location  of  an  accretion/deletion  region  relative  to  the  boundary  indicates  the 
direction  of  the  occluded  surface.  In  both  cases  shown  above,  the  vertical  line  represents  a 
boundary,  and  the  shaded  area  represents  an  accretion  or  deletion  region.  The  arrow  points 
toward  the  occluded  surface. 
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well  known,  particularly  when  applied  to  textured  surfaces. 

An  alternative  approach  involves  identifying  the  location  of  an  accretion  or  deletion 
region  relative  to  the  location  of  such  a  region  at  a  previous  instant  in  time  [13].  New  accre¬ 
tion  regions  will  appear  to  the  side  of  previous  accretion  regions  opposite  the  remainder  of 
the  occluded  surface.  New  deletion  regions  will  occur  on  the  same  side  of  previous  deletion 
regions  as  the  occluded  surface  (see  figure  2).  A  disadvantage  of  this  approach  is  the  neces¬ 
sity  to  track  and  locate  whole  accretion/deletion  regions  over  time. 

The  approach  for  identifying  occluded  surfaces  from  accretion/deletion  regions  which 
is  developed  in  this  paper  requires  the  recognition  of  similarities  between  such  regions  and 


Accretion 


Deletion 


A1  -  first  accretion  region 
A2  -  second  accretion  region 
D1  -  first  deletion  region 
D2  -  second  deletion  region 


Figure  2.  The  location  of  new  accretion/deletion  regions  relative  to  previous  such  regions 
indicates  the  direction  of  the  occluded  surface.  The  second  accretion  region  appears  to  the 
opposite  side  of  the  first  accretion  region  as  the  occluded  surface.  The  second  deletion  re¬ 
gion  occurs  to  the  same  side  of  the  first  deletion  region  as  the  occluded  surface. 
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one  of  the  two  surfaces  on  either  side  of  the  boundary.  Since  the  accretion/deletion  region 
belongs  to  the  occluded  surface,  it  will  share  certain  properties  with  that  surface.  The  com¬ 
mon  property  could  be  intensity  or  texture,  although  the  problems  inherent  in  most 
intensity-based  analyses  make  these  alternative  undesirable.  Once  again,  motion-based  pro¬ 
perties  may  be  more  reliable.  One  such  property  is  the  disparity  of  tokens  on  the  image 
plane.  Disparity  varies  slowly  over  the  surface  of  almost  all  rigid  objects.  Accretion  or 
deletion  tokens  will  thus  exhibit  disparities  which  are  nearly  identical  to  nearby  token 
disparities  on  the  same  surface,  while  token  disparities  on  different  surfaces  will  usually 
vary. 


The  system  which  was  developed  to  detect  occluded  surfaces  from  regions  of  accretion 
or  deletion  uses  token  matching  to  obtain  disparity  vector  Adds.  Unmatched  tokens  in  clus¬ 
ters  of  high  density  are  classified  as  accretion  or  deletion  tokens,  depending  upon  whether 
they  have  matches  in  subsequent  or  previous  frame  pairs.  The  disparity  of  accretion  tokens 
after  their  appearance,  or  of  deletion  tokens  prior  to  their  disappearance,  is  obtained. 
Nearby  tokens  which  are  not  accretion  or  deletion  tokens  and  which  have  known  disparities 
are  identified  and  are  used  to  identify  the  surface  to  which  the  accretion  or  deletion  tokens 
belongs.  Such  tokens  with  similar  disparities  to  an  accretion  or  deletion  point  lie  on  the 
occluded  surface. 

Three  frames  in  an  image  sequence  are  required.  Disparity  fields  D1  and  D2  are 
obtained  for  frames  1  and  2,  and  for  frames  2  and  3,  respectively.  Accretion  points  are  not 
visible  in  frame  1,  but  do  appear  in  frames  2  and  3.  Tokens  first  appearing  in  frame  2,  and 
thus  having  no  associated  match  in  frame  1,  are  noted.  If  these  tokens  have  a  match  in 
frame  3,  and  if  they  are  in  a  region  with  a  high  ratio  of  such  tokens  to  total  tokens,  they  are 
considered  to  be  points  of  accretion.  The  disparity  of  accretion  points  is  provided  by  D2. 
For  every  accretion  point,  a  search  is  made  within  a  neighborhood  about  the  point  location 
in  frame  2.  Tokens  which  are  matched  in  D2,  but  which  are  not  marked  as  accretion  points 
are  found.  All  of  these  tokens  which  have  disparities  similar  to  the  accretion  point  are  con¬ 
sidered  as  a  cluster.  A  vector  pointing  towards  the  center  of  the  duster  is  assigned  to  each 
accretion  point,  and  indicates  the  direction  from  that  point  to  the  oeduded  surface. 

Deletion  points  are  visible  in  frames  1  and  2,  but  not  frame  3.  Tokens  which  are  indi¬ 
cated  as  unmatchaUe  in  frame  2  are  noted.  If  these  tokens  have  a  match  in  frame  1  and  if 
they  are  in  a  region  with  a  high  ratio  of  such  tokens  to  total  tokens,  they  are  considered  to 
be  points  of  deletion.  The  disparity  of  deletion  points  is  provided  by  Dl.  For  every  dele¬ 
tion  point,  a  search  is  made  within  a  neighborhood  about  that  point  location  in  frame  1. 
Tokens  which  are  matched  in  Dl,  but  which  are  not  marked  as  deletion  points  are  found. 
All  of  these  tokens  which  have  disparities  similar  to  the  deletion  point  are  considered  as  a 
cluster.  As  before,  a  vector  in  the  direction  of  the  center  of  the  cluster  is  assigned  to  each 
deletion  point  and  indicates  the  direction  from  that  point  to  the  occluded  surface. 


(,  limitations 


This  boundary  detection  technique  requires  a  moderately  dense  token  set,  both  to  find 
accretion/deletion  regions,  and  to  determine  image-plane  displacements.  This  means  that 
the  two  surfaces  adjacent  to  the  edge  must  be  distinctly  textured.  In  addition,  there  must 


be  tome  component  of  optical  flow  perpendicular  to  the  occlusion  boundary,  or  neither 
accretion  nor  deletion  will  occur.  In  particular,  motion  exactly  parallel  to  the  boundary  will 
produce  no  accretion  or  deletion  regions  (see  figure  3).  Perspective  viewing  of  translating 
objects  in  principal  leads  to  difficulties  similar  to  those  associated  with  rotation  in  depth 
(see  below),  as  the  perspective  effects  can  be  locally  described  as  a  combination  of  rotation 
and  scale  change.  Fortunately,  the  practical  difficulties  caused  by  perspective  effects  are 
minimal.  When  objects  are  translating  in  front  of  a  background,  the  s use  of 
accretion/deletion  regions  due  to  translation  is  almost  always  much  greater  than 
accretic  a/deletion  regions  that  appear  due  to  effective  rotation  of  the  object. 

Certain  rotations  lead  to  potentially  confusing  situations  when  analyzing  occlusion 
boundaries.  Figure  4a  shows  an  overhead  view  of  a  cylinder  rotating  in  depth.  Figure  4c 
shows  the  accretion/deletion  regions  that  arise  if  there  is  no  relative  motion  between  the 
cylinder  and  the  background  surface.  The  analysis  above  assigns  the  accretion  and  deletion 
regions  to  the  cylinder.  Thus,  the  cylinder,  not  the  background  surface,  is  indicated  as  the 
surface  being  dynamically  occluded.  This  is  the  correct  interpretation,  as  the  rotation  in 
depth  causes  the  cylinder  to  occlude  itself  over  time.  However,  while  the  dynamic  occlusion 
is  correctly  recognized,  no  information  is  directly  available  about  the  relative  depths  to  the 
surfaces  on  either  side  of  the  boundary.  In  fact,  it  is  possible  that  the  surrounding  surface 
in  the  image  is  actually  in  front  of  the  cylinder  (figure  4b),  yet  generates  the  same  image 
sequence. 


Figure  3.  The  optical  flow  of  surfaces  A  and  B  is  indicated  by  the  vectors  on  those  surfaces. 
Since  neither  surface  exhibits  any  flow  perpendicular  to  the  edge,  there  will  be  no  accretion 
or  deletion  regions. 
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Figure  4c.  When  either  4a  or  4b  are  viewed  from  point  A,  accretion  regions  (a)  will  occur 
along  the  left  edge  on  the  cylinder,  deletion  regions  (d)  along  the  right  edge.  While  the 
cylinder  is  correctly  identified  as  the  occluded  surface,  dime  is  insufficient  information  to 
determine  the  relative  depth  between  the  cylinder  and  the  surface  at  B. 


A  different  complication  occurs  if  the  rotating  object  is  moving  with  respect  to  the 
background  surface,  the  cross  section  of  the  object  is  not  circular,  or  the  object  is  not  rotat¬ 
ing  about  its  axis  of  symmetry.  In  all  of  these  situations,  accretion  and/or  deletion  will  be 
occurring  on  both  sides  of  the  actual  boundary.  The  method  given  above  is  still  valid  and 
will  identify  both  sides  of  the  boundary  as  occluded  surfaces.  The  problem  again  arises 
when  trying  to  infer  relative  depth  given  an  identification  of  the  occluded  surface.  The 
determination  of  relative  depth  at  a  dynamic  occlusion  boundary  when  rotation  is  occurring 
is  made  possible  by  combining  accretion/deletion  analysis  as  described  in  this  paper  with  an 
optical  flow  based  approach  [4].  This  second  technique  uses  the  relationship  between  the 
flow  of  a  boundary  and  the  surface  flows  on  either  side  of  the  boundary  to  identify  occlud¬ 
ing  surfaces.  Accretion/deletion  analysis  locates  occluded  surfaces.  When  taken  together, 
both  the  occlusion  of  one  surface  by  another  and  the  self-occlusion  resulting  from  rotation 
in  depth  can  be  recognized  and  appropriately  interpreted. 

7.  Example 

The  system  implementation  described  above  was  applied  twice  to  the  image  sequence 
shown  in  figure  5,  first  processing  the  sequence  in  the  order  shown,  then  in  the  reverse 
order.  All  images  had  a  resolution  of  128  x  128.  There  were  approximately  1000  tokens 
identified  in  each  image,  and  over  800  of  these  were  matched  in  every  image  pair.  As  is 
usually  with  token  matching  systems,  the  density  of  tokens  (and  thus  disparity  vectors) 
varied  across  the  image,  being  higher  in  areas  of  fine  texture.  An  11  x  11  square  neighbor¬ 
hood,  centered  at  the  unmatched  point,  was  used  for  computing  the  density  of  unmatched 
tokens.  This  size  was  chosen  to  be  small  enough  so  that  most  of  the  neighborhood  fell 
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within  the  occretion/deletion  region,  yet  Mg  enough  to  contain  a  reasonable  number  of 
tokens  (usually  6  to  12).  If  80%  of  the  tokens  in  this  neighborhood  were  unmatched  in  the 
same  way  as  the  point  under  consideration,  then  the  point  was  labeled  'accretion"  or  'dele* 
tion'.  This  ratio  was  chosen  to  be  selectively  high,  and  yet  to  allow  for  some  incorrect 
matches  in  the  neighborhood,  or  some  extension  of  the  neighborhood  out  of  the 
accretion/deletion  region.  A  31  x  31  window,  centered  at  the  accretion/deletion  point,  was 
searched  to  find  clusters  of  similar  disparity  vectors.  This  size  was  chosen  to  be  large 
enough  to  include  portions  of  both  surfaces  outside  the  accretion/deletion  region,  yet  not  so 
large  as  to  attend  beyond  these  surfaces.  Disparity  vectors  were  considered  'similar'  if  they 
differed  by  no  more  than  2  pixels  in  each  of  the  x  and  y  components.  The  actual  values  of 
most  of  these  parameters  will,  in  general,  depend  upon  factors  such  as  the  resolution  of  the 
images,  the  amount  of  texture,  and  the  maximum  expected  disparity. 

The  results  of  processing  in  the  forward  direction  are  shown  in  figure  6a.  All  of  the 
square  white  points  represent  accretion  or  deletion  frame  2  tokens,  which  were  matched  in 
the  second  (D2)  or  first  (Dl)  disparity  field.  The  line  which  emanates  from  each  box  pro¬ 
jects  toward  the  surface  which  the  algorithm  indicates  is  being  occluded.  The  set  of  tokens 
to  the  right  of  the  leopard  are  deletion  points.  Tokens  near  the  left  border  of  the  image  are 
accretion  points,  which  appear  as  more  of  the  leopard  moves  into  the  field  of  view.  Vectors 
associated  with  these  points  indicate  that  the  leopard  is  being  occluded  by  the  surrounding 
frame.  Except  for  six  noise  points,  all  accretion  and  deletion  tokens  have  an  associated  vec¬ 
tor  pointing  in  the  correct  direction.  The  noise  points  are  not  in  the  accretion  or  deletion 
regions,  but  rather  occur  in  or  near  untextured  regions,  or  on  the  edge  of  the 
accretion/deletion  regions.  As  a  result,  there  are  either  no  other  tokens  in  the  vicinity,  or 
else  a  large  number  of  unmatched  tokens  in  the  neighboring  accretion/deletion  region. 
These  points  are  thus  incorrectly  identified  as  accretion  or  deletion  points. 

Figure  6b  shows  the  results  when  the  image  sequence  of  figure  5  is  processed  in  the 
reverse  order.  The  disparity  field  Dl  is  now  the  set  of  matches  for  frames  3  and  2,  and  D2 
for  frames  2  and  1.  Tokens  to  the  right  of  the  leopard  are  now  accretion  points,  and  tokens 
near  the  left  border  of  the  image  are  deletion  points.  Once  again,  except  for  nine  noise 
points,  all  vectors  correctly  point  toward  the  occluded  surface.  The  noise  points  are  due  to 
the  same  causes  described  in  the  previous  paragraph. 
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Figure  5.  Image  sequence  In  which  the  leopard  is  translating  from  left  to  right. 


(a)  (b) 

Figure  6.  a)  Results  of  occluded  surface  determination  based  upon  accretion/deletion  re* 
gions  for  the  sequence  of  three  frames  in  figure  1.  Square  white  boxes  are  locations  of  ac¬ 
cretion  or  deletion  points  in  frame  2.  The  line  emanating  from  each  box  points  in  the  direc¬ 
tion  of  the  occluded  surface,  b)  Results  of  occluding  surface  determination  when  the  se¬ 
quence  of  three  frames  in  figure  5  is  processed  in  the  reverse  order. 
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